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ABSTRACT 

Ground based observations at near-infrared wavelengths are severely affected by at- 
mospheric OH bands. Many authors have recognized the potential gains in sensitivity 
from suppressing these features. Dispersive instruments show some promise but are 
both expensive and complic ated to build. OH suppression filters using single ( Herbst 



1994 ) or periodic notches ( Jones ct al. 1997 ) have the advantage of simplicity but 



significant gains have not yet been realised. 

Rugate filters (with graded index inhomogeneous coatings) offer key advantages 
for astronomical imaging. It is possible to produce a transmission profile comprising a 
series of irregular and sharply defined bandpasses. We demonstrate through numerical 
simulation of rugate filters that it should be possible to achieve 95% suppression of the 
OH features in the J photometric band, while retaining roughly half of the spectral 
coverage. This would lead to extraordinary gains in sensitivity even for observations of 
continuum sources. In addition, these filters allow longer exposures before the detector 
saturates on the sky background. / and z-band filters can also be envisaged. 

In 1" seeing, a J-band rugate filter used in conjunction with a 4m telescope would 
detect a J = 23 continuum source at 5. Oct in a single 10 min exposure. In comparison, 
a conventional J filter requires multiple exposures for a 10 minute integration time 
and achieves only a 2.5cr detection. For emission line sources, the rugate filter has an 
even bigger advantage over conventional filters, with a fourfold increase in signahnoise 
ratio possible in certain instances. 

Astrophysical studies which could benefit from rugate filters are searches for very 
low mass stars and galaxy evolution out to z = 3. 



1 INTRODUCTION 



The night sky spectrum in the near infrared is dominated 
by bright emission lines from vibrationally and rotationally 
excited OH molecules in the mesosphere and lower thermo- 
sphere (80- 100km altitude). The principle source of the OH 
molecules is believe d to be the reaction be tween atomic hy- 
drogen and ozone (Bates & Nicolet 195C) which produces 
OH in vibrational states up to = 9. The subsequent de- 
cay of the excited OH, along with a small contribution from 
other pro cesses, is b e lieved to be respons ible for the OH 



intense but is still a large percentage of the background. 
Clearly there would be large potential gains if the OH emis- 
sion could be suppressed, both in terms of the improvement 
in signal to noise ratio if the sky background were reduced 
by over 90%, and in terms of the increased exposure time a 
much reduced and more stable sky background would allow. 

There has been an increasing interest in methods of 
suppressing the OH b ackground. Th e se can be grouped into 
dispersive solutions ( [ Maihara 1994 ; [wamuro et al. 1994| ; 



emission (Bates 1982; Le Texier et al. 1987). The OH emis- 



Content fc Angel 1994| ; [Content 1996|; |Piche et al. 1997 , 
and filter based solutions (Jones et al. 1997). Filter based 



s ion can vary both temporally and spatially acr oss the sky 
(Johnston & Broadfoot 1993; Ramsay et al. 1992). In partic- 
ular, the propagation of density and temperature differences 
through the atmosphere can cause large variations in both 
the relative and absolute intensity of the OH lines with pe- 
riods as short as a few minutes. The presence of this intense 
and variable background is a serious problem for earth-based 
astronomical observations in the near infra-red. In the J 
photometric band (1.12/xm to 1.38/im) around 95% of the 
sky background is in the form of line emission, principally 
OH. The OH emission in the / photometric band is less 



solutions have the advantage of being relatively simple, espe- 
cially for imaging purposes. However, numerical simulations 
of filter based solutions have b een generally disappointing 
(Herbst 1994; Jones et al. 1997) and attention has been di- 
rected towards dispersive solutions. Filter based solutions 
have su ffered from the inflexibility of simple filter profiles. 
Herbst ( 199^ ) investigated bandpass fllters but found only 
a moderate ir nproy ement in the sensitivity for the J band. 
Jones et al. (1997) investigated the use of multiple band- 
pass fllters but the improvement in sensitivity was limited 
by problems matching the periodic transmittance proflle to 
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the OH emission. However, recent advances in filter technol- 
ogy, driven by the de velopment of highly wav elength specific 
laser rejection filters (Johnson & Crane 199J ), mean that fil- 



ters with almost any transmittance profile can be designed 
and tailored to a particular problem. It is therefore possible 
to design of an on-off filter with pass bands at any desired 
wavelength. A filter blocking most of the OH lines individ- 
ually is infeasible but there are no technical limitations to 
building an on-ofT filter which masks regions of the spec- 
trum overwhelmed by bright OH vibrational bands, whilst 
retaining roughly half the spectral coverage. Such rugate de- 
vices can now be manufactured and promise major gains for 
wide- field imaging. 

In this paper, it is demonstrated that significant gains 
in the broad-band signal to noise ratio can be envisaged us- 
ing the ideas of rugate filter design. By exploiting the fact 
that the intense OH lines at wavelengths of less than 1.4/im 
are grouped into distinct and non-overlapping bands, large 
increases in the signal to noise ratio can be achieved in the 
J photometric band. The gains in the I photometric band 
depend on the assumed background continuum level, but 
worthwhile increases in the signal to noise ratio can be found 
if the continuum is small. The first section of the paper in- 
troduces the rugate filter concept. A basic design strategy 
is outlined in section 2 and section 3 describes the signal 
to noise ratio calculations. The results are presented in sec- 
tion 4. Section 5 discusses the practicality of manufacturing 
such filters and a brief discussion on how the concepts used 
could be extended and applied to other problems. The paper 
concludes with a summary in section 6. 



RUGATE FILTERS 

filters are thin film filters with refractive indices 



Rugate0 



that vary continu allv through the thin film coating ( John- 
son fc Crane 1993 ) . They are manufactured by carefully con- 



trolling the chemical composition of a mixture of thin film 
materials with different individual refractive indices during 
deposition. In the simplest case, a rugate filter with an in- 
finitely long sinusoidal refractive index profile gives a trans- 
mittance profile with a single minimum at a wavelength of 
A — 2naXp where ria is the average refractive index and xp 
is the geometric period. The width of the minimum is re- 
lated to the amplitude of the sinusoid (a narrow minimum 
corresponds to a small amplitude). For a given period and 
amplitude, the sharpness of the transmittance profile is re- 
lated to the number of periods included in the filter (a longer 
filter gives a sharper transmittance minimum). A superpo- 
sition of two sinusoids gives two transmittance minima with 
positions dependent on the individual periods and widths 
dependent on the individual amplitudes. 

The relationship between a sinusoidal filter and a quar- 
ter wave stack can by understood by analogy with Fourier 
theory. A quarter wave stack has a square refractive index 
profile, and therefore requires an infinite number of sinu- 
soids to represent it, with the fundamental geometric period 
being P = \/2na- The quarter wave stack thus gives trans- 
mittance minima at A = 2naXp/m (m = 1,2,3, ...). 

* The name derives from the Latin word for 'wrinkled' which 
describes the refractive index structure. 



Between the two limits there is an infinite range of pos- 
sible filter profiles. In principle filters giving complex and 
sharply varying transmittance curves can be designed by 
tailoring the refractive index profiles. Apodisation of the 
profiles, and quintic matching layers at the air/rugate and 
rugate/substrate interfaces can be used to reduce reflection 
losses and sidelobes in the transmiss i on profiles of real filters 
with a finite ex tent ( [Southwell 1989| ; ^outhwell fc HaU 198£| ; 
Fabricus 19921). 



The possibility of being able to design filters with a 
small number of transmittance minima at any chosen wave- 
length and for any desired width has not previously being 
considered when considering filter based solutions to the OH 
suppression problem. 



3 FILTER DESIGN 

The design of a filter with a given transmittance profile is 
a typical example of an inverse problem. Although the re- 
lationship between the transmission profile and refractive 
index profile can be understood by analogy to Fourier the- 
ory, no exact transformation between the two exists. The 
forward problem - given a refractive index profile, find its 
transmittance profile - is straight forward, but the inverse of 
this is, in general, non-trivial and the solution is non-unique. 
There is a wide range of literature dealing with solutions to 
the inverse problem using either methods based on Fourier 
transfor ms or optimisation techniq ues, or a combination of 
the two (Dobrowolski & Verly 1993). The details and relative 



merits of the methods are beyond the scope of this paper. 
To illustrate the idea of using rugate filters for OH suppres- 
sion we only require a basic method to optimise a profile. 
The aim here is not to design a perfect filter but to illustrate 
that realistic transmission profiles can be produced that sig- 
nificantly reduce the OH background in the near infra-red. 
To this end, it was assumed that the refractive index profile 
could be written as the sum of a small number of sinusoids 
and the parameters w ere optimised u sing a genetic algo- 
rithm (GA) approach ( [Goldberg 19891 ). The use of Genetic 
Algorithms to design multilayer filt ers ha s been discussed by 
Martin et al. ( |l995 ) and Greiner ( [l996| ). Martin et al. and 
Greiner both use GA to optimise the thicknesses and re- 
fractive indices of the individual layers in multilayer stacks. 
The implementation of GA used here was slightly different. 
The GA sought to optimise the amplitude, phase and period 
of a sum of sinusoids representing the refractive index pro- 
file. The algorithm used was based on the method outlined 
by Charbonneau ( 199E| ). It is described in more detail in 
the appendix but in outline it entails constructing an initial 
random population of solutions. The members of the popu- 
lation are ranked according to their fitness (or the extent to 
which they minimise or maximise some function). The pop- 
ulation is then allowed to evolve towards an optimal solution 
through a series of breeding and mutation operations. This 
approach had the advantage of allowing the possiblility of 
simultaneous optimisation of the refractive indices through 
the filter and the transmission profile itself. It was therefore 
possible to seek directly the transmission profile that gave 
the optimum improvement in sensitivity. 

The sky spectrum in the /, J and H bands is shown 
in figure 1. The emission lines are principally OH although 



© 1997 RAS, MNRAS 000, 



Rugate filters for OH suppression in I and J bands 3 



band 




J band 



jiJjI 



it: 



H band 



I 11.1,11111 ll III. I I 



bands optimally positioned for maximum signalmoise im- 
provement 

(ii) Use the 'ideal' filter as an initial goal for a ge- 
netic algorithm seeking to optimise a small number of sinu- 
soids. This produces an approximation to a relatively simple 
square wave profile. 

(iii) As the 'ideal' transmittance profile is approached, op- 
tionally switch to a genetic algorithm seeking to maximise 
a function of the percentage of object flux retained and the 
increase in the signalmoise ratio. This step improves the the- 
oretical performance of the filter at the expense of producing 
more complex (therefore less robust) transmission profiles. 

To select an 'ideal' filter, it was assumed that the max- 
imum signalmoise gain would be achieved when the bound- 
aries of the block were set just outside two OH lines. The 
blocks were positioned iteratively by summing the source 
and background flux between pairs of OH lines and posi- 
tioning the blocks sequentially such that the signalmoise 
improvement was maximised. 

To calculate a rugate filter a genetic algorithm approach 
was used to optimise a refractive index profile of the form: 



n{x < 0) = 1 



n{0 < X < xo) = Ha + Si sin(aia; -I- 



(1) 
(2) 



Wavelength [fJ^m) 

Figure 1. The sky spectrum in the /, J and H bands. Note that 
the J band OH lines are grouped into a series of non-overlapping 
vibrational bands. In the / band there is some overlap but the 
most intense OH emission is concentrated in a few spectral re- 
gions. In the H band the vibrational bands overlap and the OH 
lines are more evenly distributed. The continuous line is the cumu- 
lative background intensity as a function of wavelength through 
the band. 



there are oxygen bands around 1.27^m and 0.865/im. Also 
shown is the cumulative background intensity as a func- 
tion of wavelength. In the / and J bands the OH lines 
are grouped into a few main bands separated by relatively 
clean windows and the cumulative background intensity has 
a step-like profile. This suggests the approach of seeking a 
I and J filters that give a transmittance close to unity in 
the windows and close to zero around the OH bands. An 
alternative approach would be to attempt to block individ- 
ual OH lines. The latter approach is the method adopted 
by most dispersive OH suppression methods. It could po- 
tentially give a greater improvement in the signal to noise 
ratio for continuum objects because more object flux would 
be retained. However, because of the intrinsic width of filter 
profiles, this is infeasible for filter based solutions and the 
first approach was adopted. Note that in the H band the OH 
vibrational bands overlap and the cumulative intensity has a 
smoother gradient. Effective OH suppression would require 
a far more complicated transmission profile so consideration 
was limited to the I and J bands. 

In outline, the basis approach used for this illustration 
was as follows: 

(i) Seek for an 'ideal' filter profile with a few blocking 



n{x > xo) = ris 



(3) 



where is the assumed refractive index of the substrate, Ua 
is the assumed average refractive index of the rugate film, m 
is the number of sinusoids included and xo is the thickness 
of the film. The parameters, ai,Si and 0^ were optimised 
using genetic algorithms. 

Initially values of Oi , Si and (jji were sought to maximise 
the function: 

Sr^-l(rfllt(fc.)-rMeal(fcO)^ ' 



(4) 



where Tflit(fc) is the calculated transmittance of the filter at 
a wavenumber k and ridcai(fc) is the predetermined 'ideal' 
transmittance profile. As the function began to converge the 
strategy was switched to seeking explicitly parameters that 
maximised some function of the relative improvement in the 
broad-band signaknoise ratio, G. To reflect the balance be- 
tween the improvement in signal to noise ratio and the per- 
centage of object flux retained (r) an function of the form: 



(5) 



was used where m and n are positive powers. 

For a given refractive index profile the transmittance 
was calculated by dividing wavenumber space up into a se- 
ries of discrete bins of width 5k ~ 2 x W'^/im'^ and ap- 
proximating the continually varying refractive index profile 
by a series of thin homogeneous layers each with a constant 
refractive index. The transmittance at eac h value of k can 
then be calculated by the matrix method (Levi 1980). The 



transmittance profiles of the filters were calculated assuming 
a coUimated beam at normal incidence. Throughout it was 
assumed that the filter materials were non-dispersive and 
absorption was assumed to be negligible. 

The genetic algorithm approach is excellent at locating 
the region of the global minima (or maxima) in parameter 



© 1997 RAS, MNRAS 000, 0-|l| 



4 A. R. Offer and J. Bland- Hawthorn 



space , but the convergence to the exact minima (or maxima) 
is very slow and other opti misation techniques should be 
used to refine the solution (Goldberg 1989; Martin et al. 
1995 |). | \ simple iterative optimisation technique was used 
to fine tune the solution some of the filter profiles. The filter 
was first converted from a series of layers with a stepped 
refractive index profile to an equivalent m ultilay er stack of 
high/low refractive index pairs. Southwell (1985) has shown 



Table 1. Assumed Instrumental Parameters 



that for thin layers {nt << A where n is the refractive index 
and t the thickness) , a single layer of intermediate refractive 
index can be replaced by two equivalent layers of high and 
low refractive indices with thickness given by: 



t ty^ 



(6) 

(7) 



By alternating the order of the equivalent layers 
{{nH'nL){'nL'nH){riH'nL)-.-) this can be done without increas- 
ing the number of layers, provided the thin layer assumption 
holds. Provided the layers are sufficiently thin the new fil- 
ter has the same transmittance properties as the original 
rugate filter. The resulting multilayer stack was optimised 
by choosing an initial step size, 5t and looping over the lay- 
ers, incrementing the thicknesses of the individual layers by 
±(5t. For each layer the new fitness was calculated and if the 
change in thickness increased the fitness the change was re- 
tained. Once all the layers had been tested, if no change had 
been made to the filter the step size was decreased. Other- 
wise it was increased. The characteristic matrix of the filter 
is a product of the characteristic matrices of the individ- 
ual layers. This property means that a simple optimisation 
scheme that sequentially tests and changes each layer can 
be implemented efficiently with the characteristic matrix at 
each step being given by: 



-'filter 



{ti + 5t) = Ci_i_iCi(fi + 5t)Ci ^{ti)Ci-,f 



(8) 



where Ci is the characteristic matrices of the ith layer and: 

c,-,, = (nt,c,(fO) (9) 

Note that after the secondary optimisation, the filters 
are no longer true rugate filters in the sense that they no 
longer have continually varying refractive index profiles. 
However, they are derived directly from rugate filters. 

4 SIGNAL:NOISE IMPROVEMENT 

The calculation of the signahnoi se imp rovement followed the 
method given by Jones et al. (1997). The SNR without a 
filter is assumed to be: 

eSt 



(S : N)o 



{et{S + B)+p{Dt + a%)y/^ 



(10) 



where S is the integrated source flux, B is the integrated 
background fiux (continuum plus line emission) both in elec- 
trons s~^ summed over the p pixels, D is the dark current 
(e~pix~^s~^), an is the rms detector read noise (e~rms), p 
is the number of pixels illuminated by the source, e is the 
efficiency of the detector system a.nd t is the exposure time 
in seconds. Following Jones et al. (1997), the introduction of 
the filter reduces the object fiux to tS and the background 
fiux to f3B. The SNR becomes: 



Telescope Diameter 
System Efficiency, e 
Image Scale 
Detector Read Noise 

Dark Current 

Quantum Efficiency 

size of source 



3.9m 

50% 
0.5"/pixel 
J: 30e~rms 
I: le~rms 



1:90% 



J: 5e pix s 
I: Oe~pix~^s~^ 
J: 70% 
i< O.SS^tm, 60% @0.95Atm 
0.5", 1" . 2" 



(5* : N)i 



erSt 

{etirS + f3B) + p{Dt + cr|))l/2 



(11) 



The improvement (or otherwise) in the signahnoise ratio is 
given by: 



(S : N)f 
(S : iV)o 



'y + l + k{t,B) 
T-/ + f3 + k{t,B) 



1/2 



(12) 



where k{t, B) is a function of t and B that is independent of 
the filter parameters and 7 = ^JB- The assumed instrument 
parameters are listed in Table hi. For the J band a constant 
quantum efficiency of 70% was assumed with a read noise of 
30e~ and dark current of 5e~s~^. The assumed read noise 
in J is conservative and modern CCD's can have a read 
noise as low as 5e~ but the values were chosen to be consis- 



tent with previous calculations (Jones et al. 1997). For the / 
band the quantum efficiency curve of an MITLL-CCD deep 
depletion device was assumed. This gives a QE of around 
90% at wavelengths less than 0.85/^m dropping to around 
60% at 0.95/im. A read noise of le~ and negligible dark 
current were assumed. 

In order to keep the calculations as general as possible 
continuum sources were used throughout. For the J band 
a continuum source with a magnitude of 22 was assumed. 
The fiux was ca lculated using the zero magnitude values of 
Koorneef (1983). This gave a total fiux of 47 photons s~^ 
arcsec^ band~^ which was assumed to be constant 
across the band. 

It is also necessary to estimate the background fiux 
across the band. Maihara et al. (1993) quote a night sky con- 



tinuum of about 560 photons s~ m~^ arcsec"^ /xm~^ mea- 
sured at 1.65 /.im. The continuum is expected to be less at 
shorter wavelengths and a night sky continu um of 300 pho - 
tons s~^ arcsec"^ /im^^ was assumed (Sobolev 1978). 
This gave a J band total of 72 photons s~^ m~ arcsec"^ 
ban d~^. The J band emission l ine data used by Jones et 
al. (1997) was used (Piche 1996). The emission lines were 



represented by Gaussians of width lA centred at the line 
locations, such that the integrated flux was equal to the line 
intensity. The total flux from emission lines in the J band 
was 3560 photons s~^ m~^ arcsec"^ band~^. 

For the / band calculation an / band centred at 0.84^m 
with a FWHM of 0.239^m and a zero magnitude flux of 9.9 x 
10~^° erg cm~^ s~^ was assumed. This extends further 
into the red than many conventional / filters and covers a 
substantial portion of the spectrum included in z filters (see 
for example Fukugita et al. (199(:)). A continuum source 
of magnitude 24 was used. The night sky in the I band is 
much less intense than in the J band, with a magnitude > 19 



© 1997 RAS, MNRAS 000, 



Rugate filters for OH suppression in I and J bands 5 



arcsec"'^ compared with about 15 arcsec"^ for the J band. In 
particular the OH emission is much weaker. The vibrational 
transitions giving rise to the I band OH emission change the 
OH vibrational quantum number, v, by Ai/ — 4 and Av — 
5. The J band OH emission is from Aiy = 3 transitions. 
The transition probability falls of rapidly with increasing 
Af ( Bates 1982| ) with the consequence that the / band OH 
lines are much fainter. For example, Harrison and Kendall 



(1973) measured a total intensity for the seven principle OH 



bands between 0.72 and 0.96pim that was roughly one tenth 
of the intensity measured for the three p rincip le OH bands 
in the J photometric band. Llewellyn ( 197q ) predicted a 
similar intensity distribution. 

Estimation of the intensity of the OH lines is one of 
the major uncertainties in all these calculations. The inten- 
sities are highly variable and poorly known in all wavelength 
bands. The positions and relative intensities of the / band 
OH lines at wavelengths less than 0.94/im were taken from 
a fit to a high resolution spectrum kindly obtained for us 
by C.G. Tinney with the CASPEC echelle at the ESO 3.6m 
telescope. The data were obtained in a 6900 sec exposure at 
9 km resolution during dark time. The absolute intensi- 
ties were scaled so that the total intensity of the OH bands 
and the 0.865/im oxygen band equall ed the total intensity 
measured by Johnston & Broadfoot (1993) at an altitude 
of 2750m and latitude of 32°26.6'N. The band intensities 



measured by Johnston and Broadfoot (1993) are approxi- 
mately half th e band intensities measured by Harrison & 
Kendall (1973) but are similar to, or slightly larger th an, th e 
predicted intensities calculated by Llewellyn et al. (1978). 
The line positions of the band aro und .945/jm were taken 
fro m the spectra of Abrams et al. ( 1994 ) and Osterbrock et 
al. (1997) and the relative intens ities were estimated from 
t he sp ectra of Osterbrock et al. (1997) and Steed & Baker 
( 1978| ) . The lines were scaled so that the to tal in tensity was 



equal to that calculated by Llewellyn et al. (1978). This gave 
a total of 152 line photons s~^ m~^ arcsec"'^ between 0.65 
and Q.96pim. 

Since the / band OH lines are weaker than in J, the 
value of the background continuum is more critical in the 
signal to noise ratio calculations, but it's value is equally as 



uncertain as the J band value. Noxon (1975) measured 130 
photons s^^ m 



arcsec ^fj^m 



at 0.85/im in a dark sky 
and this was the value adopted for the calculations. It was 
assumed that the continuum was flat, giving 40 continuum 
photons s~^ m~^ arcsec"'^ in the same wavelength range. 
The resulting I band sky spectrum gave a magnitude of 19.9 
arcsec"'^ which is consistent with dark sky measurements in 
the / band. 

For both the / and J bands, the total source and back- 
ground fluxes were multiplied by the atmospheric transmis- 
sion as a function of wavenumber and binned into a discrete 
grid in wavenumber space. 

The improvement in signal to noise ratio has been cal- 
culated assuming equal exposure times with and without the 
filter. If the exposure time is limited by sky saturation, the 
maximum improvement in signal to noise ratio for a single 
exposure is potentially much higher. If t is the time taken 
before saturation without the filter, then the exposure times 
with the filter can be increase to t' = t/f3. The resulting im- 
provement in S:N for a single exposure is: 




Wavelength (/im) 

Figure 2. The transmittance profiles as a function of wavelength 
for the 'ideal' filter and filters (a) to (d) described in the text. The 
positions of the emission lines and the atmospheric transmittance 
profile are also shown. 



(g: jV)F(t//3) ^, 1 {S:N)F{t) 
{S:N)oit) ~ /31/2 (S:iV)o(t) ^ ''^ 



5 CALCULATIONS AND RESULTS 
5.1 J-band Filter 

The OH lines in the J band are shown in figure 1. The bands 
fall into three distinct regions so an 'ideal' blocking filter 
with three blocking bands was chosen. The 'ideal' blocking 
filter is shown in figure 2. This filter increases the broad- 
band signal to noise ratio for a 1" magnitude 22 source by 
a factor of 2. Higher gains are possible with more and finer 
blocking lines. However, for the sake of illustration, we chose 
to keep the filter relatively simple at this stage. 

Using the 'ideal' filter as an initial template, four filters 
were derived whose transmittance profiles are also shown 
in figure 2. The transmittance calculations assumed a col- 
limated beam at normal incidence. The properties of these 
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Figure 3. The Refractive Index Profile for Filter (a) 



filters are summarised in table 2. All filters assumed a sub- 
strate refractive index of 1.47. Filter (a) is a true rugate filter 
designed by GA alone. The RI profile is the sum of 10 si- 
nusoids constrained to lie between a = 4-Kna/{l-39fj.m) and 
a — 47rna/(1.12/^m) with no constraint on the minimum and 
maximum allowed refractive index. It was designed to min- 
imise the function G'^t^^'^ where G is the factor by which 
the signal to noise ratio is increased. The narrow dips in 
the transmittance corresponding with the outlying emission 
lines are a feature of the GA optimisation. The resulting re- 
fractive index profile is shown in figure 2. It covers a range 
of 1.34 to 1.66. With a small amount of clipping which does 
not degrade the transmittance profile, it is within the range 
allowed by real materials (eg 1.35 (cryolite) and 2.3 (ZnS)). 

Filters (b) and (c) resulted from further optimisation of 
the GA solution shown in figure 2. The optimisation tech- 
nique described in section 3 converts the sinusoidal profiles 
into multilayer stacks so the resulting filters are no longer 
true rugate filters although they derive directly from them. 
The optimisation process is illustrated in figure 3. The first 
panel shows the clipped SO/im thick rugate filter from which 
filters (b) and (c) were derived. For illustration, a minimum 
and maximum refractive index of 1.35 and 1.62 was imposed 
(eg. cryolite, alumina). The materials were assumed to be 
non- dispersive and absorption was assumed to be negligi- 
ble. The sinusoidal profile was approximated by a series of 
0.1/im thick homogeneous layers shown in part in the second 
panel. These in turn were translated into a stack of high/low 
refractive index layers (third panel). The final panel shows 
the same section of filter (b) after optimisation. Filter (b) 
was optimised to maximise the function G'^t and filter (c) 
was optimised directly to fit the 'ideal' transmittance profile. 

Filter (d) in contrast was chosen to illustrate the bal- 
ance between spectral coverage and improved sensitivity. It 
was produced by matching to an 'ideal' transmittance profile 
with only two blocking bands. 

The results of the signal to noise calculations for the 
four filters are summarised in table 3 and illustrated in fig- 
ures 5 and 6. Table 3 gives the detailed results for a mag- 
nitude 22 continuum object. Figure 5 shows the calculated 
signal to noise ratio for filters (a) to (d) and for no OH 
suppression (solid line) as a function of object magnitude 
assuming a 1" continuum source. Figure 6 illustrates the 
increase in exposure time before the detector saturates as- 
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Figure 4. Steps in the further optimisation of the GA results: 
(i) an enlarged section [x = 5 ^ lOfim) of the clipped version of 
the refractive index profile of filter(a) from which filters (b) and 
(c) were derived; (ii) an approximation to (i) with O.l/^m homoge- 
neous layers; (iii) conversion of (ii) into high/low refractive index 
stack; (iv) the result of optimisation (filter b). 



suming a 1" magnitude 22 object and pixel saturation at 
10^ electrons. 

It can be seen that all rugate filters ofl^er significant im- 
provements over standard photometric bands in terms of the 
increase in signal to noise ratio for faint sources, with a fac- 
tor of two improvement in signal to noise ratio for filter (b) . 
Improvements in signal to noise ratio are possible for sources 
fainter than about magnitude 15 for a 2" source, 16.5 for a 
1" source and 18 for a 0.5"source. A secondary advantage 
is the increase in exposure times allowed, with maximum 
exposure times increasing by a factor of 30 for filter (b). 

Filter (b), optimised to a function of the form G"r™, 
gives the best performance in terms of both the increase in 
signal to noise ratio and the increased exposure time allowed 
but this is at the expense of the spectral coverage. Filter (c) 
retains a greater percentage of the object fiux, at 44% and 
still gives a significant improvement in the signal to noise 
ratio. The transmittance profile of filter (c) is more feasible 
in practice than filters (a) and (b). Broad features will be 
less affected by small deviations in in the refractive index 
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Table 2. Summary of Filter Properties 



Filter 


Description 


Average RI 


Min RI 


Max RI 


Thickness 


No. of Layers 


Ja 


True rugate maximising G^t^/^ 


1.5 


1.34 


1.66 


50/^m 




Jb 


Optimised to maximise G^t 


1.5 


1.35 


1.62 


50/jm 


500 


Jc 


Optimised to 'ideal' filter 


1.5 


1.35 


1.62 


50/im 


500 


Jd 


Optimised to maximise Gr 


1.5 


1.35 


1.62 


50/im 


500 


I 


Optimised to 'ideal' filter 


1.5 


1.35 


1.62 


50/im 


500 



Table 3. Improvement in Signal to Noise Ratio for a 600s integration time. Results are given for objects of 
magnitude J = 22 and / = 24. 



G T 13'-''^ 

source size: 2" 1" 0.5" 

'Ideal' J 2.04 2.03 1.98 0.47 0.050 



Filter (Ja) 


1.74 


1 


73 


1 


69 


0.40 


0.049 


Filter (Jb) 


2.05 


2 


03 


1 


97 


0.36 


0.030 


Filter (Jc) 


1.76 


1 


75 


1 


72 


0.43 


0.058 


Filter (Jd) 


1.46 


1 


46 


1 


45 


0.60 


0.166 


'Ideal' I 


1.23 


1 


21 


1 


15 


0.45 


0.135 


Filter (I) 


1.17 


1 


16 


1 


12 


0.50 


0.179 



" 1/(3 is approximately the factor by which the maximum exposure 
time before saturation is increased in the sky dominated limit 




Figure 5. The signal to noise ratio as a function of magnitude 
for a 1" with no OH suppression (solid line) and with the four 
filters (dashed line:filter (a); dash-dot: filter (b); dotted line: filter 
(c) and dash-dot-dot-dot: filter (d)). 



Figure 6. The time until saturation (assuming saturation at 10^ 
electrons/pixel) for no OH suppression and for the four J band 
OH suppression filters discussed. 



profile and departure from normal incidence than narrow 
dips aligned with individual OH lines. 

Filter (d) gives a far better spectral coverage than the 
other three filters with 60% of the object flux being retained. 
This is at the expense of some loss in sensitivity with a signal 
to noise improvement of 1.45 for a 1" magnitude 22 contin- 
uum object. However, the relatively large fraction of line 
emission retained limits the increase in maximum exposure 
time and implies that the filter performance will be far more 
dependent on the intensity of the OH lines, which is a highly 
variable and uncertain quantity. 



5.2 I band filter 

The OH lines in the I band were shown in figure 1. The 
OH bands at the long wavelength end of the band are well 
separated, but the windows between the bands are no longer 
so clear. In particular, there is a relatively intense oxygen 
band around 0.865/im. At shorter wavelengths the bands are 
less intense but overlap so again the windows between bands 
are not so clean. 

Figure 7 shows the / band equivalent of filter Jc. As 
for the J band filters, the transmittance profile has been 
calculated assuming a coUimated beam at normal incidence, 
and assuming non-dispersive materials. A substrate refrac- 
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band Filter 



6.1 Filter Manufacture 



1 n 



liliili 



0.7 



0.8 

Wavelength {/j, nn) 



0.9 



Figure 7. The transmittance profile as a function of wavelength 
for an I band OH suppression filter. The dotted line is a product 
of the atmospheric absorption and the assumed I band profile. 



tive index of 1.47 was assumed and the initial refractive 
index profile, expressed as a sum of ten sinusoids, varied 
between 1.30 and 1.71. This was truncated at 1.35 to 1.62 
before the final optimisation. The properties of the filter are 
summarised in table 2. 

The improvement in signal to noise ratio was calculated 
for a magnitude 24 continuum object, and the results are 
summarised in table 3. The corresponding values of the sig- 
nal to noise ratio for a 600s integration time and a magni- 
tude 24 1" continuum object are 9.2 with no OH suppression 
and 10.6 with the OH suppression filter. As can be seen, the 
results are much less spectacular then for the J band, al- 
though a small improvement in signal to noise ratio of a 
factor of 1.16 can stiU be found. Greater improvements in 
signal to noise ratio are possible but with increasingly com- 
plex transmission profiles. The relatively poor performance 
is partly a result of the distribution of line emission in the 
band but largely a result of the relatively high fraction of 
the background intensity in the continuum. Note that the 
improvement in the signal to noise ratio depends on the bal- 
ance between the background line and continuum intensities. 
The values chosen here are conservative. If the continuum 
is completely neglected than the improvement in signal to 
noise ratio for a magnitude 24 1" continuum object rises to 



1.39, sriggt'sLiug a potential 39% impiovymeuL in the signal 
to nois e ratio if the continuum ia very small compared with 
the intensity of the emission lines. 



6 DISCUSSION 



The major challenge of the rugate technology has been to 
develop design software compatible with the control systems 
of vacuum deposition chambers. Coating designs which can 
be expressed as the sum of up to a dozen sine waves ap- 
pear to be the most straightforward to manufacture. But 
it should be stressed that the technology is sufficiently new 
that filter transmission profiles as complex as those proposed 
in Fig. 2 have not been attempted by commercial compa- 
nies before. A constraint imposed at the outset was to limit 
the optical coating thickness to ~ 20/im, and infrared coat- 
ings to « 40/im, since thicker coatings are a major technical 
challenge. Even these limits are at least twice the thickness 
of routine multilayer coatings used in interference filters. 
At the outset, the number of layers, and hence the coat- 
ing thickness, relates almost directly to how long the filter 
resides within the vacuum chamber. Interference filters are 
produced with real-time quality control and it becomes more 
difficult to control the transmissive behaviour as more layers 
are laid down. 

Motivated by our designs, B. Bovard has demonstrated 
with a combination of tantalum pentoxide (rio — 1.5) and 
silicon dioxide (rio = 2.3) that the desired filter response 
in Fig. 2ii can be achieved with a 40/im thickness rugate 
coating. The narrowest rejection band at 1170nm drives the 
total coating thickness; the broad rejection bands are much 
less challenging. For the Ta2 05:Si02 refractory oxide com- 
bination, the troughs achieve blocking to better than 0.1% 
while the peaks have steep sides and average better than 
90% transmission. He finds the central wavelength of each 
rejection band can be achieved to within 1%, but the width 
is more uncertain by as much as 5% of the rejection band. 
Bovard has achieved optical quality and a uniform spec- 
tral response over a 150mm diameter and suggests that a 
200mm diameter is within reach. Rugate coatings require 
intricate (mostly proprietary) deposition techniques carried 
out with great care over several days in a vacuum cham- 
ber. This makes them expensive with costs per filter close 
to ~US$30,000, although possible approaches to reducing 
costs include subdividing a coated blank with a diamond 
pencil. 

It has been shown that effective J band OH suppres- 
sion filters can be designed in principle but the robustness of 
such a filter is an important consideration in practice. There 
are several effects which serve to degrade filter performance. 
Thermal effects induce a bandpass shift at the level of 0.2 A 
K~^. Small corrections are possible with filter tilts if the 
original filter is specified at a temperature warmer than un- 
der observing conditions. Deviations from optical fiatness 
are caused by microstructure within the coatings and by 
bowing in the filter substrate due to s trong surface tension 



(stress) wit hin the coating dielectric (Ennos 1966 



Martin 



et al. 1991). Basic approaches to reduce bowing are to ap- 



ply the coating layers to both sides of the substrate, or to 
bind the multilayer coating to a thick (~10mm) substrate, 
but a large optical thickness can seriously degrade the op- 
tical performance of the camera. An alternative route is to 
match materials with tensile and compressive stress (e.g. 
zinc sulphidexryolite, zinc sulphide :thorium fiuoride). This 
contrasts with Bovard's hard coating where both dielectrics 
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are compressive, a combination which has proven stabihty 
and longevity. 

Small differences in manufacture induce in situ stress 
across the plates, alt hough ion bombard ment can remedy 
this to some degree (Martin et al. 1991). Deviations from 
optical flatness cause the filter peaks to spread, thereby fill- 
ing in the troughs. 

The performance of the filter when expressed as an im- 
provement in the signal to noise ratio has a highly compli- 
cated dependence on the transmittance profile. Some insight 
into the sensitivity of the signal to noise improvement to the 
degradation of the filter profile can be gained by fitting But- 
terworth functions to the low transmittance notches in the 
'ideal' J filter profile shown in figure 2i. The Butterworth 
profile is given by: 



Butterworth profile fits with n = 3,6,10 and 30 



/n(A) = 1 



A -A, 
h/2 



(14) 



where Ac is the central wavelength of the notch and h is the 
FWHM (full width at half max) of the function. Figure 8 
shows three Butterworth functions with the same FWHM 
and central wavelength as the square notches in figure 2i 
but with 71 = 3, 6, 10 and 30. A square profile results when 
n oo. By varying n and h the Butterworth functions can 
be used to model the effects of both changes in the width 
of the notches and increasing roundness of the notches. Fig- 
ure 9 shows the variation in the improvement in signal to 
noise ratio as a function of incremental change in the half 
width of the three notches in figure 8 for n — oo (square 
wave profile), and n = 3,6, 10 and 30. A degradation of the 
profile through small irregularities would both smooth the 
profile (ie decrease n) and change the half width so extrapo- 
lation to a real degraded filter is difficult. However, it can be 
seen that the signal to noise improvement is more tolerant 
to a broadening of the notches (increase in halfwidths) than 
to a narrowing of the notches. The percentage background 
intensity retained can increase rapidly as the notch shrinks 
and additional strong OH lines are admitted. The percent- 
age drop in object flux resulting from a broader notch is 
much smaller than the percentage rise in background result- 
ing from a narrow notch. 



6.2 Instrumental Applications 

Up to this point, our calculations have assumed a coUimated 
beam at normal incidence. However, wide field imaging sur- 
veys are carried out with fast cameras in which blocking 
filters are traditionally used in the converging beam. It is 
well known that such beams modify both the first and sec- 
ond moments of the filter transmission profile. The former is 
rectified by shifting the desired filter response to red wave- 
lengths at the design stage. The latter limits the speed of 
the beam depending on the precise filter structure and the 
angle subtended by the detector seen from the camera lens. 
Analytic approximati ons t o the first four moments are given 
by Bland-Hawthorn (1997). We find that the rugate profiles 
presented in Fig. 2 suffer negligible degradation in beams 



slower than f/3, inclusive of non-telecentric rays over a 20' 
field. 

The new-generation Rockwell HAWAII arrays provide 
high (60%) quantum efficiency in the near-infrared with 
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Figure 8. Butterworth profiles with the same central wave- 
lengths and half widths as the notches in the 'ideal' J filter but 
with ra = 30 (dashed line), n = 10 (dot-dash), n = 6 (dotted) and 
n = 3 (dash-dot-dot-dot). 
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Figure 9. The variation of signal to noise improvement as a 
function of the incremental change in the half widths of Butter- 
worth profiles with n = oo (solid line), n = 30 (dashed line), 
n = 10 (dot-dash), n = 6 (dotted line) and n = 3 (dash-dot- 
dot-dot). When 5/i = these correspond to the transmittance 
profiles shown in figure 8. Positive &h corresponds to broader low 
transmittance notches. 



moderate performance (50%) in the / and z bands. An opti- 
cal system built around a HAWAII array could achieve com- 
parable sensitivity in standard 7 and rugate J bands. Such a 
device could also capitalize on an IzJ filter to enhance the 
sensitivity at near infrared wavelengths compared to con- 
ventional optical bands. For example, figure 10 illustrates 
a transmission profile that will reduce the sky background 
for A > l^m to the same level as the sky background for 
A < 1/im, thereby allowing a relatively uniform IzJ band to 
be defined. Clearly this profile also incorporates an extended 
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zJ Filter Profile 
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Figure 10. A transmittance profile as a function of wavelengtli 
for an IzJ filter that would reduce the sky background in J to 
the same level as in I. The dotted line is the atmospheric trans- 
mittance. 






Figure 11. K-corrections at I and K compared to two rugate 
filter designs, Jc and Jd (see Fig. 2). The galaxy types shown are 
elliptical galaxies (solid lines), early- type spirals (dotted lines), 
and late- type/irregular spirals (dashed lines). The small bumps 
on the rugate curves are due to the H,K break moving through 
the sub-bands. 



J or zJ filter from 1.05 to 1.38/im which gives access to an 
additional clean spectral window not used in the J filters 
discussed earlier. 

A very different application of rugate technology would 
be to devise a beam splitter whose complementary images 
amplify some characteristic in the spectrum of a class of ob- 
jects. This idea, discussed in the next section, has the poten- 
tial to usher in a spate of inexpensive astronomical imagers 
as the technique can be exploited with a rudimentary optical 
design. 



6.3 Scientific Applications 

Rugate filters are expected to increase observing efficiency 
at most sites, and therefore the scientific applications are 
numerous. One example, discussed further below, is very 
low mass (VLM) stars and brown dwarfs. These are so rare 
and faint that they require dedicated surveys over huge vol- 
umes - which means either very wide field or very deep sur- 
veys. The mos t reliable survey diagnostic is the I — J colour 
(Leggett 1992), which is exactly the wavelength range where 
rugate technology will produce the largest gain in sensitivity. 

For continuum sources, we have seen that signahnoise 
gains as high as 2 are possible in the rugate J band. This may 
find important uses in studies of galaxy evolution since the 
K-corrections at J are much closer to th ose at K (Fig. 11) 
than to optical bands (Glazebrook 1997). In particular, the 



K-corrections for the different morphological classes are re- 
markably uniform for rugate filters Jc and Jd over the red- 
shift interval z — 1 — 3. Thus, evolutionary signatures should 
be much easier to monitor in a rugate J filter than at /, 
and the higher sensitivity at J compared to K makes it the 



preferred near-infrared band out to at least z = 2. The mor- 
phological types start to diverge when the H[,K break enters 
the band: this occurs a,t z — 1 for / and z — 2 for J. The 
K-corrections for the rugate filters are remarkably stable as 
they agree to 0.1 mag out to z = 3. 

Even larger gains are possible in observations of 
emission-line sources, assuming that the spectral line falls 
within one of the transmitting windows. If the object signal 
arises in a discrete, narrow interval transmitted by the fil- 
ter, no signal from the object is lost by the OH suppressing 
bands, in which case signahnoise gains as high as 4 are pos- 
sible. In redshift surveys, roughly half of the survey volume 
is lost to the suppressing bands, although this overstates 
the problem if the line-emitting source transmits in several 
bright lines within the broad window. To date, searches for 
high redshift galaxies have concentrated on only a few strong 
lines from Lya to Ha. In Table |^, we show the transmitted 
redshift ranges for three prominent emission lines. The red- 
shift slices transmitted by rugate filter Jc are well matched 
to the redshift range over which the star forma tion rate d en- 
sity is expected to peak in the early universe ( Ellis 1997 ). 

We reiterate a point made by Jones et al. ( 1997D that 
in circumstances where a rugate filter does not produce a 
substantial gain, this may still be the preferred option due 
to the longer exposure times and suppressed background 
variation between exposures. It is anticipated that this will 
lead to much better image mosaics than have been possible 
to date. 

This paper has concentrated on the use of rugate fil- 
ters for OH suppression but the great versatility of rugate 
technology could find many uses within astronomy. For ex- 
ample, in the case of brown dwarfs the ability to define ir- 
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Table 4. Rugate filter Jc: transmitted redshift ranges for prominent emission lines 



Hq 


[OIII]5007 


[Oil] 3727 


0.71-0.76 


1.24-1.30 


2.01-2.09 


0.79-0.82 


1.34-1.39 


2.14-2.21 


0.90-0.93 


1.49-1.53 


2.34-2.40 


1.02-1.09 


1.65-1.74 


2.56-2.68 



regular bands within a single filter suggests an alternative 
approach to finding these elusive objects. A t near-infrared 
wav elen gths, the spectrum of Gliese 229B ( [Geballe et al 



19960 as a roughly sawtooth appearance. A rugate filter 
could be made to operate as a beam splitter such that the 
peaks of the sawtooth are transmitted and the troughs are 
reflected by the filter. If the separate paths are imaged onto 
two detectors, candidate objects would appear bright in one 
image and dark at the same location on the other detector. 
The graded index coatings are sufficiently fiexible that the 
precise positions of the peaks and troughs could be chosen 
to share the sky background equally between both filters. 
Thus, rugate technology could give rise to a range of niche 
instruments designed to find specific classes of astrophysical 
objects with distinctive spectra. 

In summary, interference filters offer a practical ap- 
proach to achieving significant gains in OH-suppressed imag- 
ing. We recognise that more sophisticated techniques could 
be conceived. One possibility is the use of an OH absorption 
cell to absorb the OH line emission directly. But the pro- 
ducion and maintainance of a vibrationally excited OH pop- 
ulation with a sufficiently high column density would be a 
major technical challenge. The vibrational bands contribut- 
ing in the J band are the f^S— >5, 7^4 and 6-^3 bands, 
thus OH of vibrational levels at least up to = 5 would 
be required at relatively high concentrations. Relaxation of 
the vibrational states would rapidly depopulate the higher 
vibrational levels and some means of maintaini ng the vibra- 
tion ally excited population would be required (Kondratyev 
196S |). y his simple idea is likely to prove complex and costly 
to implement. Although less elegant, the OH suppression fil- 
ters can be produced relatively cheaply with existing tech- 
nologies and could easily be incorporated into conventional 
instruments. 



7 SUMMARY 

The sensitivity of astronomical observations in the near in- 
frared is limited by the presence of intense atmospheric 
OH emission bands. The conventional approach to improv- 
ing sensitivity has been to increase the telescope aperture. 
However, in limited cases, noise reduction can achieve ma- 
jor gains in sensitivity. In this paper we have shown that 
the simulated rugate filters can achieve extraordinary gains 
for imaging at J, and modest gains through I and z, at 
the expense of loss in bandpass. A similar H band filter 
would require a much more complicated transmission profile 
and, since the transmission profiles proposed for the / and 
J bands are already near the limit of currently realisable 
profiles, it was not considered in detail. Plans are already 
well advanced to manufacture a rugate J filter for wide field 



imaging at the Anglo-Australian 3.9m Telescope. We have 
provided examples of astrophysical studies that will clearly 
benefit from such a filter, as we propose to demonstrate in 
subsequent papers. 
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APPENDIX A: GENETIC ALGORITHMS 

Genetic algorithms are optimisation techniques that draw 
on the Darwinian idea of evolution through survival of the 
fittest (Goldberg 1989). They are particularly suited to non- 
linear optimisation (minimisation or maximisation) prob- 
lems with many distinct local minima where gradient fol- 
lowing optimisation techniques will fail to find the global 
minimum. There are a number of possible implementations 
of the method. The method used he re clo sely follows the 
algorithm described by Charbonneau (1995). 
The basic steps are as follows: 



(i) Form a random initial population of solutions 

(ii) Assign a fitness value to each member of the pop- 
ulation related to how closely it approached some desired 
solution 

(iii) Choose pairs of individuals from the population and 
form 'offspring' by breeding the two individuals. Introduce 
mutations into the genes. 

(iv) Establish the fitness of the offspring and, if they are 
fitter than the weakest member, insert them into the popu- 
lation 

(v) Repeat 2-4 until convergence is reached 

An initial population of Np individuals is created ran- 
domly. In the present case each member of the population 



corresponds to a complete set of filter parameters, 5i,ai,(f)i 
for i = l,m where m is the number of sinusoids in equa- 
tion ^. These phenotypes are decoded versions of their asso- 
ciated genotypes , the set of 'genes' that determine the pa- 
rameters. Each individual has associated with it 3m genes, 
each gene being a sequence of 5 integers between and 9. 
The associated parameters are then given by interpreting 
the 5 integers as the first five significant figures of a real 
number between 0.0 and 0.99999. The parameters are then 
given by: 

Si = Smax X X3i-2 (i= 1 ,2,3, . . . ,m) (Al) 

ai = {amax—amin)XX3i-l+amin (1= 1 ,2,3, . . . ,m) ( A2) 



bi ^2tv X X3i 



(i=l,2,3,...,m) 



(A3) 



where amax , ctmin and Smax are imposed constraints on the 
allowed range of the parameters. Here the Xk are given by: 

5 

= ^ 10"'/5{fc-i)-^j (A4) 

where the Ij are the 5 integers representing the individual 
gene. 



5fe = {l5k-4, hk-S, l5k-2, Isk-l, Isk) 



(k=l,3m) (A5) 



The Xk serve to translate between the 5 x 3m integers repre- 
senting the genotype, and the physical properties 5i, Ui and 



The population is ranked in order of fitness, however 
fitness is defined. In the present case the fitness is defined 
either as being related to the least squares deviation between 
the filter transmittance profile (Equation ^) or as an explicit 
function of the improvement in signahnoise ratio (Eq. ^). 

Once the population is established, breeding can be- 
gin. Individuals are chosen for breedi ng with a probabilit y 
proportional to their fitness ranking (Charbonneau 1995). 
When a pair of individuals are chosen the breeding operation 
is initialised by making copies of the parents. For example: 



Parent 1 = {Ii,l2,h, ■ ■ -jlbx^m) 
Parent 2 = (Ji, J2, J3, ■ ■ ■, JsxSm) 



(A6) 
(A7) 



On breeding, and exchange of genes takes place. A random 
number is generated between and 1. If this is less than 
a preset 'cross-over' probability then a random point is se- 
lected in the two genotype arrays of 5 x 3m integers, say 
position n. From that point forward the genes of the two 
parents are crossed to create two new individuals: 

Offspring 1 = {h,h, h, ■ ■ ■, I„-i, Jn, Jn+i, ■ ■ ■, JsxSm) (A8) 

Offspring 2 = (Ji, J2, J3, ■ ■ ■,Jn ) (A9) 

Mutation may also occur during breeding. A random num- 
ber is selected for each of the 5 x 3m integers, if this is less 
than the (small) mutation probability the integer is replaced 
by a randomly chosen digit. 

The genotypes of the two offspring are translated back 
into two sets of filter parameters and the fitness of the indi- 
viduals is calculated. The population replacement strategy 
used i s the 'replace worst' strategy described by Charbon- 
neau (1991: ). If the fitness of the new individuals was greater 



than the weakest members of the population the weakest are 
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replaced by the new individuals. A generation is defined as 
a series of A^p breeding operations. 

The rate of convergence of the solutions is rapid initially 
but becomes slow as the optimal solution is approached. The 
rate of convergence can be controlled to some extent by vary- 
ing the mutation rate but other more direct optimisation 
techniques may be necessary to fine tune the solutions. 
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